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7 . ' ' 

INTRODUCTION 



As we all know, one of the most significant movements within^ ^ 

the American educational system, during 'the past 'decade is that of 

bilringxial education. Thi5 movement was, among dther things, Ae 

out cfome, of research (Kobrick,J972; Rodriguez, 1974), indicatiKfi 

that the treatment of minority school children was characterized ' ' " 

by neglect and negation*, . ' 

* t * 

One of.^the publications* thaj: helped precipitate this movement 
wasl.the Colem^a Report (CoJ^eman et al., 1965) that portrayed the 
plight ©f many minority students by comparing- th^ir schpol achieve- 
ment, academl.c .self -concept , and dropout figures with ^hbs^^^ 
English-speaking students, • ■ ' • . i 

Tfie pedagogical/political effect that this and other similar- 

studies had on bilifigual-bicultural education was extremely beneficial 

* . ^' ' ' . -> 

<Zirkel, 19746^ p. 30), since edi^ators^ and ^politicians, For the first 

time, viewed the cultural and linguistic diversity of minority, \, ^ 

' ' ' ^ % 

xh^id^n/as an asset rathet than, a liability to, academic success^ 

' V * / * 

(Anderson^ and Boyer^ 1^70; Saville -^nd Troike, 1971), 

• . * - * ' .Z' 

This change of attitude, however, woulcf have been of no conse- ^ / 
quejice if 'the .fe.deral •government had nOt pxovidW financial support 
to bilingdal' pi^ograins^ especially after the landmark Supreme Cour^ " 
•decision of Lau vs, Ni,chols ^(1974) : Despite the Lau decision and 
subsequent development ^f many bilingual ^ograms , bilin^gual/bicorlt^ural 
education has not^yfet achi^eved its full potential. A serious drawback 

"* ^ ' ' , r 

to its realization is the lacK of teaching materials and curriculum 
designed 'for bilingual '•schools. 



This Jack jof materials, in turn, is to a great extent due lo the 
lack of languige' asse^srafent instruments, a problem which came t(5^ li^ht 
in both the Lau ^vs*; Nichols a^d the pdbaaa California cases. . Many 
researchers d^he field'-'also p^^|ft^' outl that thei?e is a relative 
paucity of research data on bilingual education in general and on 
language dominance in particular/ Blanco (1977) attributed this 



paucity to limited federal funding for such research, stating tl^ t th e^ 
United States has spent only one- t'enth of one percent of its funding 
on research to improve the quality .of bilingual progjrams '(p,4) , ^ 
Expressing a similar criticism, Woodford ^1977) noted that in 
addition tQ o^her shortcomijigs Cf such programs^ the "least has beep 
done in' the areas of ^ evaluation** . (p. 130). He further noted that in 
most school area's, language^dojninance determination is based on such 
'*cumbei;^ome and' time -consuming proce^5^s" (p. as 'student inter- 

views^y teachers 'Or teacher aitls. ' J . 

i. 

But even with the use of te^ts, otKer problems appear, y^rber 
' (1976), for example, cited empirical evidence indicating that 
"certain psychoeducational p-laceroent *tests do not measure the learning 
abilities* they were^. intended to /measure ''when used with linguisti^cally 
and/or culturally different children" (p. 31). 

Discussing the same issue frpm a flifferent perspective, Eel.ls 

\ ' ' ' I • 

(1'953) also pointed out that for a xest to be'free'of cultural bias 

it *Wst be composed of items which'deal with "materials common to the' 

various subcultures in which it is to ^be ii^edV (p. 292). 

In the^.past, standardized test<s with minority group children ' 

resulted in an unfavorable assessmeijt of these children. These 

discriuA^atory testing practices, wHich resulted in multiple travnias 



for such children, led to court battles and demajids for "conpensatory 

punitive damages" to plaintiffs in the 1970s. Such cases as Stevart • 

^ sr^. 'i>hilips in Massachusetts ;^(1970)- or Covarrubias vs. Sail Diego Upified 

School District (1971} revealed the damage of iiscriminatdry' te^^ting, ' 

^whiGh placed students in classes for the "educable mentally retarded.*; 

These cases, which sought substantial damages ($20,000 per student), 

**presaged a far-reaching revision of current testing methods" (Olkland', - . 

•1977, p. 64). ^'^oreover, they l«d the justices- in other cases^, such as 

th£: Lau vs. Nichols and Diana vs . Caiifomia , t® call for a. moratorium 

on testing .language-minority children- with instruments based on white, 

' middle-class American children, ^Their rationale w^s-thatf "the relia- 

^ bility, validity, and horming of these. tests has 'been established for 

the general popul at ion* rather t^ii for ^ particular biculUyural group" 

(Bemardoni, 1967, p.' 1). • * ' 

Another result of these judicial proceedings, was an impetus for 

development of new assessment techniques' fer minority children. Through 

funding from DHEW, foundations, or publishing firms, ^many minority 

language dominance tests were developed (itiring the 1970s. 

Despite the criticism, from some writers,^\i^ the validity and ^ 

reliability cff a number of such instruments, more progress has been 

made in this .area iii the. last decade than in the previous 50 years. 

However, while a.multidue of taftguage domifiance assessment instrument* 

♦ 

•and curriculum materials have been developed for Spanish-speaking 
children, a ^^city of similar materials is apparent for other minority 
group languages. ^ • 

Greek ^s a cafe^ iix poiat. yhile this minority group is greater 
in 3i?e t^n other group^s, such as Filipinos and Portuguese, which ' ^ 



: ' . ' ^ • • . ? 

r ' ' * * 4 

have such instruments (Lo^k, Fletcher, and -Reynolds , 1978) , ^nothing 

similar has been developed until recently for th^is group. According 

to the U.S. Bureau of Census (1576) ^over half^a nfillion people ' 

(542,000) in the United States have Greek as their native tongue. ^ 

Also, according to the^ Survey of 'Income and Elation of the U.S. 

Bureau of Census^(ia7^) , approximately 8fe,000*Greek minority Children 

Jjetwfeen tAe ages of 6 ta' 18 di? not 'have Engji^h as 'their rfative 

toftgue cTr did not 'u^e English at/home, ^ 

*These children nee^ appropriate language screening tests for 

diagnostic and p-lacemeht purposes. Some teachers of Greek bilingual 

programs use Spanish language dominance tests, which they have trans- 

fated into, Greek,, for such purposes. It is generally agreed, however, 
/ - ' ^ ' 

that such- translations contain numerous potential problems and are 

usually inappropriate. The best solution to the problem, would, .then, 

' 'be' .the develd'pment of an inilrument that would be based oji* research and 

I • 

data derived from the same language group, Greek In this case, for 

which it will be defvelop^d. s « ' 

\ . ' ' 

It is true that the academic achievement of the Greek immigrants^ 

(Krug, ia76; Moskos,^ 198^0) *has been, surprisingly high compared to 
other minority groups. 'However, 5ome Greek students, have been sent . 
to classes, for the nventally handicapped, becayse they scored low on 



culturally, biase.d achievemeht^esjs or because they had to answer a 
test in a language the'y did not ^derstand. Such children should be 



Appropriately assessed before they' were assigned ta^classes for^^e 
mentally .handicapped. Thus, problems, traumas^ ^inksfigmas, could 
have been, avoid'e4, benefiting both'' the students and society. The 
v^velopment^then, of such an instrument by this re^eariiher - the 



0* 



building of which 11 be discussed in^the followiifig pages - aimed 
at 'filling this great gap in the atea of language assessment of Greek 
tilingual children and was also a r^ponse to federal legislation 
cajling for such instruments. 



A 



• 
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TTie subjects for. the dSVeiopment^f the instrument were four 
hundred and three (4(73) male and female students attending (Srades 
1-4 at the Greek Bilingual Program and Greek Parochial School of 
Tarpon Springs, Florida; the Saint De^netrios Greek Parochial School 
in New York; and th^e Budlong Elementary Public School irr Chicago, 

All the above schools, with the exception of* the Tarpon Springs 
Parochial School, are day schools. The* Budlong. School is a public 
school with many bilingual programs, one of which/ is the Greek 
Bilingual Program, The student population i5 basically middle or 
/ upper -lower class, The.^tudent^ of the Greek program c6toe mainly from 
/new immigrants of a mid^ite^-so^ioeconomic status. Many of these 
students,, therefore, are Greek language dominant, [The overwhelming 
majority of^the students of the Soterips Ellenas School in* New York, 
on/th^ other hand, are bom in the United States and come from 
middle'to upper-middle class background. The Saint Demetrios students 
present a mixture of older and recent parent immigration. Most of 
these s^dents come from' a middie to upper-middle class bacfkground. 

Criteria used for this selection were locales with a concentra- 
tion of Greek-speaking people, and with the ptesence of one 'or more 
Greek bilingual schools. The selection of these schools and geographic 
regions is assumed to be repres^tati;^^e of Greek 'bilingual students of 
the same age in other parts of the country. This procedure, in tum^ 
of selecting a wide geographical representation, enhanced the 



external validity of the instrument / compared to a selection of a 
more limited scope. Furthermore', the sample size, which exceeded 
300 students, was a good representation of the total population and 
adequate for the development of the instrument.* 

Devel'opmenf of the instrument began. with a large number of 
items. Subsequent revisions reduced them to 80 items each for "the 
Greek anc^English versions (60 pictorial 20 verbal stimuli) . 
The selection of the initial items was based on a ragdom sampling 
of words appearing in the 'vocabulary li$ts of the G^des 1-4 
reade^rs for Greek and American children. A,^ool of more than 60 
multiple choice rtems was derived from such vocabulary lists. 
These items* were divided into four general categories aimed at • ^ 

f . • 

testing the subjects' knowledge of family, neighborhood, school, 
^ ^d church objects. Likewise, more than 20 Greek and English queetion 
items 'were designed to measure the subjects' command of grammar and 
syntax in each language. 

The -final instrument consisted of 80 itenfs, 40 for the Greejc ' 
and 40 for th'e English^e^, 30 of which are ^signed to elicit 
a response to a verbal stimulus ^usfLng multi{)le choicepictof ial 
afC^m^tives. Specifically, e^ch multiple choice item consists 

L 

^ of a word stimulus on the left, followed by a series of five related 

pictures, one of which is the correct answer to -the stimulus. ^ 

Accordingly, respond^nttl were^ asked to match the word with' the 

appropriate, picture. Th.e^ remaining items are verbal stimuli in 

•sentence form, designed to elicit a grammatically and syntactically 

correjct answer to a question. ' 
♦ • 

r 



Special Care was taken to make the test items reflect "the dual 



history and culture of the sub^^^s. Thus, *six itelns in the mult 

choice part'^df th^ instrument * and two question items differed in the 

Greelc^and English conqponents of the tests. The difference refllsctefd 

the disrfmilir sociocultural background of a child raised in Greefce 

as opposed to the U.S.A. For example^ item 11 in the multiple choice 

test depicts a carrot in the English test but an olive in the Greek 

• test, since olives are a much mor^ common item in the Greek diet 

than carrots; similarly, item 49 depicts the/^erican flag in the 

English component and the Greek in the Greek, - ^ . 

, This general item formulation was presented to the participant 

of both the general and special Greek colloqium at Florida State; 

. • University *for feedback and recommendations relevant to further 

improvement. ^ The participants of the general colloqium were 

approximately 25 doctoral- students of the j^lorida State University 

bilingual program, imany of whom were former bilingual teachers and 

who represented such dive^^ language groups as Glseek,* Spanish, 

Tagolog, Vietnamese, and Arabic, The parti^pants* of the Greek 

colloqium were eight' doctoral students in the Florida State ^University 

/ 

Greek bilingual program,' some of whom were graduates pf institutions 
of higher education in Greece, The instrument was also presented for 
feedback to othet language specialists and experts at Plorida St,ate 
^University and elsewhere, V , * 

^ The experts consulted, suggested various changes and/or 
substjktutions in the itJems, as well* as positioning of itelns within the 
test. The instrument was revised and agajn presented to the ^experts 
who considered it adequate ♦for its purpose, this examination, 



critique, revision, and .final approvai of the instrument constituted , 

, one of the basic steps in establishing its'content validity. 

After final revision and approval by -the panel of reviewers , the' 

. pictorial test items were given to an illustrator for illustration. 

After 'fl lust rat ions were completed, the test was finalized in both Greek 

and English. Jhe test items were placed in a progressive order of 

difficulty,. It was expected that only the students of higher grades • 

woulrd be able to answer most or all of the items correctly. ^ \ 

- Selection of the items was based on the following criteria: * 

(a) the' items should take cognizance of the chil^dls ability* to use 

'such an i^em ats a particular age-, (b) the'itenjs should be interesting 

and enjoyable enough -to stimulate the child's response, (c) the 

, items should sample a variety of vocabulary and activi/ies, and - 

\ ' ' . 

(d) the items shoufd include, where. possible, the same, siiAilar, or 

equivalent stimuli in both languages, ' ' > 

' Pii6t Testing and Results ^. r 

The pilot testing irtcluded 42 subjects from Grades 1-4 of the 
Greek Bilingual School and the Church School in Tarpon Springs, 
Frorida, Of these 42 test responses - 8' at Grade 1, 10 at Grade 2, 
9 at^Gracle 3, and 15 at^ijrade 4 - two were found invalid and were 
excludedofrom computer analyses. . 

The! tests^ were subseqqently cc^ded and given to the^ FJorida * 
State University Evaluation Service Center fox a Standard Item ^ 
Analysis Program, The main s^itist;ics of interest in this analysis 
^^.fwere the mean,, standard' d^v^ation , reliability, and , standard error * 
of measui^ement of each group. These statistics are presented in 
Table 1, ' ^ . 
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Table 1 
• I* 
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' k = 60 for Part A IT 

= 20 for Part B ' * ; ^ 

. ^ . • * • ' , * " . 

A large uumber of items in both ^ the Greek and English tests ' 

t^' yielded a large difficulty index, ife. were easy, *while a few of them # . 

'presented a small difficulty index, i.fe. were difficult- To 

remedy this problem the verbal cues of 'these items were cljAftged, • ' y% 
^ . In the^item analysis, the number of English test items that did nq.t 
^ perform well was larger than the Greek one. .The reason for this Is 
*hat the subjects found many more e'tsy items in the English section* 
of the. tes.t than in the Greek one. Thus, almost all chan^ges 'in thi' 
English testyre focused on increasing th^ difficulty of these 
it'ems\ ^ ' ' 



r 
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In Section B of the GreeR t^st, the^ixanguage component, it was 
a^lso found that cert^n itfems were out *of progressive difficulty 




^ o^r^er and were reordered. The sam^ approach was employed in- Section 
. ?^of the^EnglisH test. - ' 

^ ^ _ The individual grade reliabilities of Se^q^ion A 9ot the^Greek 

te^t Weje highen than throse of -the^English, ,with the dxcepti:on of ^ 
'^ade 4 /where tft^ reliability 'tpf the Greek test *wa3*r^fend the 
English ^98. The reason for the generally" Hi gW reliabilities 



. o^'t'he^<3reek test' is attribTated to ^he greater disorimination* Value 
o^'tfie Greek items,- probaCTy, caused by their lower difficulty index 
and greater standard deviation compared to their English counterparts. • 
The* reliabilities of Section B, the language. component of 'the^test, 
are generally 'higher on the Eng^lish .test , %ut the difference between * 
-r^the two tests here l^siifalleip "then in Secti^i A. One notable 
excreption in this ^section, however, Us^GifedeM of- the Greek, test, 
where the reliability i^zero. This Vesuljtwas 3ue to' the fact, 
tha|I\most of^he first gra(Jek"sj|j|ients iieje lAable to read or write 
in Greek, since the Greek alphabet and^J'angiiage are more difficult 
. than English, the e^ffect of the^ difficulty/in reading and\r^iQg 
upon the subjects is also manifested In the\lo\4 reliabiLitr appearifig^ 
in the same grade and section of th«»English\/^t . The ^ason for 
the higher relitibilities of .the English test 
. generally easier to th^ubjects than those of the G^eek test. This/ 
' ease-, which -is demonstrated .in the'higher means of the Englis&i " 

section, resulted i^ higher item ,var;i;ance and thus higljer rettiabilities . 
^'''^^JaAlXjuJ^^l^^ length of this pomponeht 

only 20 items one is drawn to the conclusion that its reliability 



4 ' . . 



' % < -.12 • 

is quite, ^igl?* 

In comparing thg' overall * re liabilities l(^ect ion. ^T^and B) of 

/the' JSree^ land English tests, it is apparentTthat the reliability 

of the Gi^^pfk te3t is higher than 'that' of th^/Englisfe, with the 

of Grade 4, where they are almost equil : '9? and .97, 
• » 

- Examining the means of the test, oti tht other hand, one easily 
notes the substantial difference between the Greek and English te^t 
means; J The differentee' clearly denotes that the subjects sco;ged ^ 
• Jtigher'^in Engfish than in Greek, A easily explaii).ed fact when one 
considers that most of thetsubj.ects haye been in the United States 

• * .. . ; . , 

for a number of y^rs and have also been itomersed in an English 

' * d • 
language environment, ^ * y 



. Fdeld Testing 



Schools axHl Subjejcts 

After con^juter analysis of ,the pilot testing data, and ^ * 
ensuing item revision, the instrument was rea^y for field testing. 
The field testing^ conducted in early^Jin^e lfi79, .included two 
stages: test and ret;est. The original number of subjects per 
grade. and school are as follows: ^ , ' 
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and Grade' 




Grade 


School' 1 , ■ * 

* » 


School 2 


School" 3 


' . Total 
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• 
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. 25 


' '37 " ' 
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11 
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: 16. 


,9^ 


•'48 


73 • 


1-4 , 


90 


89 


182 


361 * 



' 13 . 

In order to obtain test-retest data, the instrument was * 
administered twice^ with an interval^ of "approximately a wee.k betw^n 
■ the* two -test administi^atibns. Of the^361 >gubjects^ tested, only 337 
responses were used for comput^' analysis.^ Th^ remaining 24 tests 
were excluded from tb^ analyses, either because they were, deemed 
invalid for various reasons, including "Christmas-treeing," * 
insufficient maping, or reading and writing difficulty (10 cases), 
or because the subjects were not present in both^'administration^ of 
the instrument "(14 cases). The total iiumber of cases excluded from 
the analyses is quite small compared to the total sample population. 
The high rate of clean data is partly attributed to favorable'' cooper- 
ation from the. school personnel' as well as from the subjects. 
Data Coding; " ^ * ^ 

The response data were ^oded onto optically scannable answer ' . 



? aata wei 
:ion ; 



sheets. In addition; 4nd prior to this, the*writer read and marked 
§11 Section B test, both Greek and English. At the end, each subject 
had. two opscan sheets of data, ofie for the test and one for the i:etest. 

After the completion of coding, a general check was made on all 

r ^ ' 

coded data, test responses and identification data coding, to ensure 
that there were no mi^feing data and that all mSirks were properly 
entiredj The rate of missing or incomplete data was less than one 
percept • 

, 'The dkta were then separated according to grades and an answer 
key .for each test and section was made. The data were given to the 
Florida State Oniversity Evaluation Services to be trajj^ 



'rrred to- 
could be 



a disk file so that the appropril.te statistical analyses 
made. These analyses included the following:^ (4) tes^rieliability* 



16- 



"14 



(C9efficient alpha), (b) mean, .standard deviation, .an4 SEM, (c) test- 
^retest reliability, .(d) ,p values per: item, fq) prfSt b^sWial values 
per item', and (f) concurren]^ vaWdiiy Analyses ^^p^he- analyses were- 



performed for each part and the ,tot^ of the Engrislitand Greek tests 



by grade, as well as for the total groaJp of subjepts. 



- / 
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RESULTS AND DISCUSSION 



The results of the^study included th^ following: (a) analysis of 
the itep J)ool, (b) item selection for final in'strument , . (c) character- 
istics of final instrument, (d) test-retest reliabilitie.s, (e) reliabi- 
lities b)A Behoof 'a:nd sex and "(f) conqurrent validity, ^. 

|nalysiS'of thg Item Pool * 

The statistical characteristics of- the itfem pool werft examined 
to facilitate ^^ectipjt of items Tor^the final insti^ument. First, 
the means and standard jdeviations of the piq)ils* scores fo«r each 
'part of the^ test* (Greek and English) were ^computed. Second, the 
internal consistency, reliability coefficiipnts for ttje ^arts were 
calculated^ Third, discrimination indices, correlations ^between 
each item and the part score were calculated. The same statistics 
we,re calcjiila^ed 'fot the total 80-item pool. The means,' starfdafd 
deviations, and^ internal consistency of scores over the Items in the 
p'qol are shawn in Table 3, .-^^ - . $ ^ • 
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Table 3 

* Characteristics of the Item Pool (N - 302) 



_ ' SubtestiA . Subtest B ^otaj. Test 

aE ^ « : — ^ 

Grade ^ X .^SD r^^ ' ? SD r^^ X §D ^r^ ^ 



English 7e5t 



1. 


85 


35.14 


8.43 


.876 


^7.40 


5.22 


.904 


42.54 


12 


.76 


.927 


2 


61 


38.60 


5.62 


.765 


11.^67 


4.09 


.862. 


50.27 


8 


.72 


.868 


3 


87 


43.87 


8.46 


.913 


14.15 


3.83 


.846 


58.39 


10 


.81 


.927 


4 . 


69 


39.48 


4..8r9 


.^^772 


16.97 


3.13 


.838 


• 56.45 


7 


.04 


.853 


1-4 


302 


43.10 


8i£I 


.501 


12-57 


5.5d 


.921 


55.66 


13 


.20 


.941 










GreeJt Test 












• > 


1 

r 


85 


32<45 


13.60- 


..947 


4^93 


4. 56 


.898 


37.38 


^1 


.67 


.955 


2 


61 


42.33 


8.81 


.890 


7.73 

• 


4.^4 


.849 ' 


50.07 


11 


.50 


.911 


3 


^87 , 


43.03 


roii6 


.923 


10:30 


4.20 


.821 


53.84 


12 


.81 


.530 


4 . 


. ' 69 


44.171^0.25 


* * 
.930 


12.26 


5. ,01 


.904 


56.43 


14 


.36 


.951 


1-4 


302 


40.11 12.04^ 


.941 


9.04 


5\32 


.904 


49.15^ 




.05 


.954 



The 4ati show tha]^,<4h& mean performance of subjects was greater 

on tl^e English items than on the "Qreek items.' Since the content of 

tl\e' items was desinged to be parallel, 't;)iis 'difference in performance 

« 

is probably due to greater competence of the subjects in the English 
language, which is the primary Jpanguage in the. subjects ' school^ 
Subjects were more variabje in their performance on the Greek items 
than the^ English items*. This finding might be associated with 
the difference in means and a slight jtendency toward ceiling' effects . * 



For example, the large3t standard deviation is associated with the' 

smallest mean for total scores on both the English and Greek tests. ' 

The items ha.ve a substantial degree of internal consistency as 

reflected in the alj)ha coefficients. 

^ Item Selection for Final Instrument 

. - In examining the data for* internal consistency, item and part 

•analyses showed that the\o-item pool possessed the appropriate 

statistical characteristics to permit development of a shorter*"^ 

instrument. The final instrument included 40 Greek and 40 English items 

Specificalfy, the\election of the 40 items (30 njultiple ' choice and* 

10 free-response 4tems)'was based on the following criteria: (a) each 

item-should have acceptable point biserial value, (greater than of 

equal to .30), (b) the parts* (English and^Greek) of the instrument ' 

should be based, , item by item, on the .same pictorial or qi^stibn 

cues, (c) the two parts of the final instrument should po'^ssess the 

closest' p5ssible-point bis«rial values, item by item, -and items whose 

• ' ^ ' • , *' 

Greek or English components might present significantly different 

poirtt biserial values should be excludied^ and (d) the, resulting^ ' t 

Greek and English parts of the final instrument shbuld -present 

CCMBparable reliabilities. Thus, the final parts of the instijjument ' 

were designed to be of equal diff/lclilty for a balanced bilingual child. 



All items without parlance were automatically excluded from 
consideration in the fwial selection process. Furthermore, the 
selection of an item was based on its o^ve^ll performance and not 
merely on its performance in selected grades, lased on the foregoing 



t>6th 



criteria, 4(J items were finally seleeted for j^th the Greek and English 
parts of the instrument. ' ' . . , * 



• • • ^ - 

. ' * ' Qia^cterlstacs '0^ Final Instrument v 

, ^ ' . > ' 

Reliabilitijes ^and othe^ pertinent statistics obtained by the 

final 4.0-item instrument ^pre^ented in Table 4. 

The reliabilities on bot;)i^t,he Gr^ek and English parts of the / 
•* ^ : * ' \ * ' ' ^ 

instrupent are quite high, and only slightly lower than thqse r . 

the 'ehtite Item pool (sei^table 3). The differences between the 

reliabilities of the twp^parts of the instrument are negligible and 

not statistically si^ificant. The largest difference^^appears in 

Grad^ 4, whejre the reliabilities were .78 for the English part and ?92 

far the Greek jpai't/ This difference may be attributed to a low variance 

and high hn§an for the English part for this grade, which^m^y have 

caused a ceiling effect*, as we*ll as to a restriction in the sample 

compilation, sinte the majority oi subjects for this grade [47 out 



of 69) caBit from fhe same school'. ^oWever, the difference beti^een 
the two' relial)ilities is not statistically significant. 



Table ^4 ' 

Statistical Char-actexistics of the Final 40-Item 



r I 

ween V 



Inptirument by Grade 


Level and 


Overall 




■■ ' ( • 


i 




Differences between 


^ Er.glisa iTes-*: i 


* Graek 


Test 


the two* paurts 


. • * 

Gr. n X SD ^^r^:^ SEM 


X . SD 


r^^ %EM^ 


1 

X# SD 'r- , SEM 

^ 



1 85 p. 10 8.04 .910 2.41 20.15 9.93 .936 2-.38 2.95 8.25 .830 3.38 

2 61 30.15 5i70 .843 2.28 28.05 6.62 .865 2.38 2.10 8.13 v840 3.25 

3 87 33.98 5.10 .863 1.89- 2^.27 7.30 .895 2.34 4.70 8.37 .870 3.01 

4 6? 34.09 4.00 .776 1.92- 30. Q6 8. 01 . 922 2..24 4.03 7.75 .850 3.Q2 

1-4 302 30.49 7.80 .924 2.18*. 26.50-9.10 .931 2.3.7 3.99 8.22 .840 3.29 



2u 
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As shown in*' Table 4, means for the Greek and English parts ar^% ' ' 

-* ^ " " 

consistently differ^ivt. This difference, which favors the English--" 
part and is larger on the higher grades, is statisfically signl^^ie^nt* 
and indicates a great er.^:ompetence of the subjects in the English 
language/ ^ - ^ * ' ;^ \ 

^The standard deviations of the instrument are generalj);*^high 

coflipared to those of tlie 80-item^pool (see T^irle 3), sinGe^al^l items 

J, . - * 

^xcluded from the final instnuient had ^low or no variance and thus 

their exclusion had no serioas effect on the variability of the 

instrument. The standard deviations of the Greek palT"are generally 

higher than tiiose of the English, These higher^standard deviations and 

accompanying larger .variances are -the basic reason for tHeHvgher 

reliabilities Of the Greek part;, since there is a. direct relationship 

between- these two statistics. The Grade 4 standard deviation 'of the 

GreeL-part is higheir than expected, especially 'when compared to the 

stan^^ deviations of Grades 2 alid 5\ The reason for this high 

standard jieviation may be du^ to ,a wicfe vari^abiiity in language 

« 

ability*-among the subjects of' this group. 

The standard errors of measurement for both parts are comparably 
small. These small ^standard errors of measurement are als^ reflected " 
in the generally high reliabilities of both parts, since there is an 
inverse relationship between these two statistics. 

The reliabilities of the difference between scores on the * 
English and Greek parts are quite large and stable across grade 
levels. These valu^ are quite satisfying, because it is the 
difference between the scores on the English and Gt^ek parts that 
constiiiutesrtbe language dominance score. Therefore,, these reliabilities 



are orucial to the effectiveness of thil4 ''instrument in reliably 
different iatir^g between Greek and English dominant' children.^ 

Xhe remaining statistics for the^differences, means, standard 
deviations, and^ standard -errors of measurement are also stable. 
The standard error of measurenjsnt values are higher than those of, 
each individual part because the variances of errors of measurement 
are^ added together when the difference between parts is determined. 

Test-Retest -Tleliabilities 

The instrument was administered a second time to the subjects, 
approjcimately 6ne week after the first administration, to examine 
the stability of its results over^a period of time. Table 5 shows 
these* test-retest, reliability results by grade level and overall. 



Table 5 
Tes^Retest Re j.i abilities 
by Grade Level azd Overall 



English Partj 



Gree.^ Part 



'differences between 



_ . the Two Parts 



Gr. 


n 

f 




X 


• 


*SD 


^11 


SEM 




X SD 


'11 


SEM ^ 








SD 


\^ 


SEM 


1 


85 


El 


23. 


10 


8.04 


.715 


2.41 


Gl 


20,15 9.^3 


.754 


2.38 


Dl 


2 


.95 


8. 


25 


.686 


3.38 






£2 


22.86 


8.44 




4.47 


G2 


19.59 9. .59 




4.80 


D2 


3 


.27 


7. 


58 




4.24 




61 


El 


30. 


15 


5.70 


.863 


2.23 


Gl 


28.05 ^.62 


.821 


2.38 


Dl 


2 


.16 8. 


13 


.860 


3.25 






E2 


29. 


75 


6.27 




2^2 


G2 


27.58 7.09 




'2^.98 • 


02 


2 


.17 


7. 


89 




2.92 


3 


87 


El 


33. 


98 


5.10 


.822 


1.89 


Gl .29.2/7.30 


!476 


2.34 


Dl 


4 


.70 


8. 


37 


.572 


3.01 






E2 


33. 


20 


5.34 




2.24 


G2 


23.73 7.33 




5.39 


02 


4 


.47 


9. 


06 






•t 


69 


-£1 


34. 


0^ 


4.00 


.661 


1.92 


Gl 


3(kOo 3.01 




2.24 


Dl 


4 


.03 


7 


75 


.361 


m ^ 

3..02 






E2 




4.09 




2.37 


G2 


28.48 9.50 




3.14.. 


D2 


6 


.54 


8.50 




3.15 


1-4 


302 


El 


30. 


40 


7.80 


.853 


2.18 


< 

Gl 


26.50 ?.10 


.781 


2.37, 


Dl 


3 


.99 


8 


22 


.928 


3.29 






E2 


29.90 


7.96 




3.10 


G2 


25.78 3.37 




4.40*> 


D2 


4 


.12 


8 


38 




4.36 



• t 
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The test-retest reliabilities, with the exception of Grade 3 of 

t 

the Greek part, showed considerabje stability pf results over tine. 
« * \ 

Additionally, test-retest reliabilities of the difference between the 
y 

two parts of the instrument are substantial. » 

\ ' ' 

Cojlsidering the niinerous soup^s of error tf^at can enter into a 

1 " ■ 

test-retest administration as conipared tp a single administration 

of an instrumerit, the, obtained overalls reliabilities of .85 for the 

La^iish part and .78 for the Greek seem adequately large. Thc^ ^ 

reliabilities of the differences between the Eriglish and Greo^ 

parts are especially encouraging in view of the difficulties often 

associated witlrthe use of indices generated from the difference • ' 

, ' / * ^ ' 

between, two scorap. ' • ' ' * . 

• • • a 

Reliabilities bv School 



table;* 6, which sunmiarizes the reliabilities 'of the instrument. 

^by school, shows th^t rVliabiltt ies were acceptably high bo-th for 

individual schools as well assoverali. Additionally, the reliabilities 

of the differences 'between the two paVs bjMndividual school' and 

overall ^re' extreme^ly close. The means of the two components are 

very similar for school 1, but they are higher for the English part 

\ - ' 

in scnooi.S i^d especially school 2, denoting that -the subjects of 

^ ' ■ * r • 

scl>dols 3 and ^'had greater competence in English. ^This is explained 
by the fact that school 1 is a public school with ^ large variability 
**of ability ar>ong its subjects nan^ ofi which are' recent Greek 
^mmicjrint cnildren while "^^cKools 5 and 2 are parochial.-w ith a 
mor^ honogeneous, '^Americanized'^ middle class student population. 
The means of the difference between t^e two parts express the 



• numerical differenc^ between the pnglish and Greek parts of the 
instrument and the higher s'coring of the subjects, especially in 
school 2, on the English part. 

f ' Table 6 

• Reliabilities of the Final Instnnnent by School (s) 



X 



/English 



, Greek 



Differences between 



the T^.hto Parts 



S^h.» ^ n 



SD ' SEM 



SD 



^11 ^^^^ 



'l 79 '26.31 9.46 .935 2.27 25.9^ 10.12 .952 2,23 .32 8.4^ .850 3.30 



2 
3 



48 26.»89 9.10 .941 2.18 19.30 10.72 .952 ^.36 7.59 10.06 .900 3.22 



175 33^21 5.30 .847 2.07' 28.34 7.19 .889 2.37 4.87 6.64 .770 3.19 
1-3 302 50.-^9 7.80 .924^2.18 , 26.50 9.10 .931 2.37 3.^i9 8.22 .840 3.29 



Finally/ the standard jdevi at ions of the difference are stable and 
) JLarge' across Whools, The stafidard errors of measurement |f e almost 
idefitical amongXschools , showing that the irrStrugnent 's performance 
was similar amongXschools ; This similarity, along with similarities 

\ i 

among the standard c^^viatiohs and reliabili^es, show flfat results ^ 
of the insl!rument wer\ similar among different school settings. # 

Reliabilities by Sex V 
S4x as a variable did not appear to have an effect dn the 
feliability of the instrum\nt. Table 7 shows the similar reliability 
-values yielded for -females lind males on both English (.917 vs. .925) 
and Greek ("1925 vs. .942) parts. The table also, indicates that 
the standard error 6f measurement valuas for males and 'females 
are ^so- small on both pajts . 
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The tests yieldecL-eaight ly higher standard deviation vaaues 
for males, especially on the Greek' component , resulting In slightly 
higher but not / ^atistically, significantly different reliability 
values for males when compared to females. 

ReTJaHllities by Sex 













Difference betw^n 








Zn^lish 


Greek 


the Two Parts 


• Sex 


Gr. 


n 


9 

X SD ^11 


SEM X ' Si) ^11 SExM 


X . SD ^11 SEM 


M 


1-4 


138 


29.56 8.27 .923 


2.32 24.62 10.03 .942 2.41 


4.94 9.53 .880 3.34 


• F 


1-4 


164 ^ 


"31.12 7. 57*. 917 


2.12 27.71 8.17 .925 2.12 


3.41 6.62 .780 3.11 




A 


difference of means 


in favpr'9f the female subjects is shown, 
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which is statistically significant on both the English and Greek 
parts at the p<.05 level. The yield of higher scores for female 
subjects coincides with research findings (Restak, 1979) on sex as 
a predictor of language acquisition. 

Ir^/The reliability of difference values between the two parts, 
a difference, not statistically significant, is sho\mfin favor of the 
males .88 vs. .78. This difrtrence may be attributed to the 
larger standard deviation of the scores of the males. ^ 

/ 

Concurrent Validity 
Content vafidity of the instrument v^as established through a 
panel of experts. *To further investigate the validijty of the 
instrument, hovr-ever, an examination of its concurrent validity 
was undertaken. ^Teacher ratings of the bilingualism of each student 
were usod as an' indopendent criterion measure of language doninance. 



9^ . or. 



Each subject was assigned^ a code refleetin^ his/her language classifi- 
catcon as designated -by the teachers; ^ code of 1 indicated Greek ' 
lavage dominance^ a code of J indicated baianced^bilingualism, " ^d\. 
a coUe of 3 indicated English language dominance. The teacher* 
'Ratings were then transferred to the subjects' computer record and - 
a correlation coefficient expressing the teacher/ instrument agreement - 
was obtained. , * 



Such correlations are usually low due to the multiple sources 

' ' ■ -.i 

of error entering their calculation. Sources of errpr may arise 
from a teacher's subjective evaluation of a subject's bilingualism^ 
Such errors may be'based on factors such as the length of acquainta^e 
with the subject, teaching experience, tWcher^s degree of bili^gualism 
and 'Subject's foreign accent or lapk of it, resulting dn leniency 
error, halo' effect. error, and bo on.' Such errors increasa^the ^ 
likelihood of misclassification of a subject." Another iinport ant - 
factor which contributes to the misclassif ica^tian^^of a subject is 
'the category of balanced bilinguals, but also J^il'inguals with a 
leaning towards one language. ^The ^extent of this leanings is quite 
difficuIt^W ascertain and is therefor.e an important potential 
source of error. Finally, the imperfection the instrument per 
se contributes to error. ^ 

The concurrent validity. coefficients for' this study were obtained 
in the following way. First, the Greek and English scores £or each \ 
subject were calculated and LTtWGreek score was subtracted from the 
English score. ^S^cdnd, the subjects* were classified as Greek 
dominant, J)alanced bilinguafp^r English dominant based on the \ \ 

m 

difference calculated in the first step. A subject was classified 




as Greek or English dominant ^if the|difference^ between hi^ 'o'r her ^ 



Greek and English scores was larger than .apprQximately _+1.5 standard 

errors of measurement, or _+5 ppxnts. If the score difference was 
* * . * 

<" smaller than th% mentioned e fro if -of mea*^urement difference, .the * * 

subject was classified as a balance^biUngual . The selection #of 

this valuQ for the ^lassification*bf the subjects was arrived at 

through a process of professional judgement and examination- of the 

' data. ' ' 



( The resulting cl^sifications pf subjects were then ^rapared 
to the teachs^ ratings. The correlation coefficients obtained per 
grade and overall- were ,a^|^l lows : Grade 1, .47; GraSe 2, .47; 



Grade 3, .56; Grade 4, .27; aJId Grades 1-4 



■ \ 
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SUMMARY, CpNCLUSIONS, LIMITATIONS", 

♦ « 

p, AND RECOMMENQATIONS 

Summary 

The item pool of th*e' instrument was c^eloped during the spring 
of 1979, and the item selection process and evaluation was- critiqued 
by over 30 bilingual doctoral students and language experts^ 
Through thi^s procedjjre the content validity of^the instrument was 
established. The item^pool was then pilot tested^ with 42 subjecfs 
in Graded 1 through the Greek bilingual schools in Tarpon 

SpjLings, Florida, at the end of May 1979, An item analysis of the 
data rev.ealed the„ strong as well aS the Weak points of the instnjment 
In general, findings revealed (see Table 3) that the item pool's 
reliabilities were generally high, but that certain items, especially 
in the English part, were easy. These items were, therefore, 
Ijjibstituted with others of bettet discriminating value, 
' ' The field-test administration that followed in early June" 
•included three scf\pols (two in New York and one in Chicago) and 
an initial popula^on of ,361 subjects attending Grades 1-4, The 
item pool was administered to the subjects twice to examine both 
Its test and .test-retest reliabilities. Furtheijore, teaCher ratings 
of the slibjects' language dominance were obtained^ Such ratings 
were later compared with the test results in order to examine the 
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cohcur'i^nt validity of the finals inst^rtlment . The analysis of test 
i^liabilities, conducted according to grade and ^school Iras well as ^ ' 
across schools and grades (see^Table 3) | ^owed that reliabilities 
for all segments of the item pool (Subtest X, Subtest B, and Total 
Test) were quite high, both across grades and schools (.94 for the 
English and .95 foi* the Greek part). * * 

After the internal consistency reliability of the item pool 
was establislTed,. selections of the best 40 items for the Greek 
and for the English were mad#. These items constituted the final • 
instrument. Selection of these items was based primarily on the 
point biserial values. Items were selected that had large point 
biserial, valued on both* the English .and Greek ^rsious of the t^st. 

Jhe^ final in-strument (see Appendix A) was then examined for 
its internal consistency and o^er pertinent statistics. The r^tllts 
(see Table 4) shcSwed that t^e internal consistency reliabilities, 
both by grade and overall, were high for both components of the 
instriiment (.92 for the English vs. .93 for the Greek) and only 
slightly lower than those of^the 80-item pool. They al^o showed 
that the reliabilitie*6 of the difference, •which are c^ruciai^to the* 
efjectivenej^ of the inijtrument, were quite large ^d staM^- across 
grades. The instrument was then examined for its test-iiS^Rt 
reliability , to determine its stability oveT a p^.iod o^ time. This 
examination (see Table 5) showed that the instrument generally 
yielded high reliabilitr^. Th/ values of test-retest^ reliabilities 
were, however, lower than the internal consistency, reliabilities" 
(.85 for the>JBnglisjti and. 78 for the Greek), due to additional sources 
of error that tiormally enter into a test-retest reliability. 
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JTie instrument wad also/exakin'ed by means of a^t-test, to determine' 
if. any statistically significant difference was evidenced in the 
reliability values by schopl- or by sex of the subjects. ' The statis- 
tical analyses .(see Tables 6»ami 7) showed that such differences . 
did not exists ^ > • 1^ 

Finally, the instrupitent was examined for its concurrent 
validity. Thus, the t^achei* 'ratings of the subjects were compared 
to /he *Lf<<^ences in test scores ojj^He same subjects, and a 
correlation coefficient was ^obtained. The res.ults of this analysis 
shdwed considerable Support -for the concurrent validity of the 
instrument. * " . * ' 

^ • Conclusions 

Examinations ^^Jtbd-linst rumen t in relation to field-test 4data^ 
. internal consistency reiiabiltty, test-retest reliability, jefiabii- 
lity by school and sex, ani^roridity demonstrated that^^the instrment 

^' > ^ 

possessed'high^eliability and usable validity values. Furthermore, 

the data' from the instrument was consistent with exiSiting theories 

about the relationship •betwe'eil the language ability of subject*s 

o£ different socioecoBOinLc backgrounds, as well as the well established 

fact^-o#-rdifference in language aptitude between males and females.' ^ 

% . - 

These facts suggest th'dt the instrujjent constitutes a respec- 
table instrument for the measurement of the language dominance of 
Greek bilingual children attending Grades 1-4 in the United States. ' * 
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Limitations of the Study 
r"^^ : ; — 

'and Recommendations 



Despite careful consideration of possible sources of error, 
the study presents certain limitations. Fpf^ exemple, the study 
does not provide for a parallel fopn which wQuld b,e an additional 
measurement of the instrument's reliability and would have been 
of great assistance to school personnel and test administrators. 

A more serious liinitation, however, is the circularity appearing 
,in the instrjiment characteristics. Ideally; selection x)f the best 
40 items 'to build the final instrument should have been followed 
by a new admii^stration of these items to the subjects to obtain ^ 
a more accurate picture of the statistical characteristics of the 
instrument. Such an administration, however, was not feasible due 
to time constraints and problems of school approval for additional 
testing.. . ' , * 

Anather limitation df the instrument is also the assumption 
thatNthe difficulty *of its Engiish part is equaj to that of the' • 
Greek part. This assumption is primarily based on the lact that 
the items selected came from the same sampling domain and were 
judged to be -of ec^ual difficulty. Additionally, the administration 
of an instrument during the end oi the school year does ^ot meet 
ideal test conditions, since school personnel and subjects are 
.more concerned with year-end tasks. A futiHe researcher should' 
try .to administer ^udrSn instrument at a more \)ropitious time of 
the school yeair. Future research should also include a more 
balanced subject population within graiies, especially for the fourth 
grade, where 47 out of the 69 subjects come from one school only. 



30 ' 

Finally, it 'is recommended that future research, should attempt 
tp expand the scope of the present instrument to include' all ' 
elementary sch^l grades, thus providing the ^dhool systems of the 
country with ^^eliabl^ and valid instrui^t for the measurement 
of the iMguage dominance of Greek bilingual children. 
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APPENDIX A 
LANGUAGE DOMINANCE TEST FOR GR^K 
.BILINGUAL CHILDREN: / 

' % 

ENGLISH AND GREEK PARTS 
(FIELD TEST) 



(Greek version omitted becaxiae of 
poor reproducibility) 



) 



r 
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Name 



-Date 



Gradej;^ 
Sc^iool 



Time Started 



Time Completed 



Bird 



toy 



oS^ctlons- to the Student: 

Read the directions t6, yourself^ as your proctor reads 'th^^out loud 
to you. 

In the following exercise you will see fi^e pictures on the right 
and a word on the left of each row. Put an X on the picture that means 



a;jh 



the saft as the word on the left. BE SURS TQ ANSWER ALL^^ite^UESTiONS; 




EXAMPLE : I 



















You wI'lT see the word 
bird. Now do th,ie,next e;^d{rpte 
EXAMPLE: 11 



64rd on the left and an X on xhe picture df 



r 



the 

















1^ 
















1 
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Name: / ^ Date 

Grade: ^ 

School : 

Tine Started: * . * 

Tine Ended: 

DIRECTIONS 

^lease answer as man)^ questions as you <can in. the s:ice provided after edch 
question. Do Not use a "YES" or "NO" answer . Your answers will not be seen 
or graded by your teacher. 

QUESTION: What Is your rfame? - ' . 

ANSWER : My na;ne is John or my natne is Mary , etc. 

QUESTl6f<S 

1. Q. How old are you? 

A. I ■ 

2. Q. Here you bom in the United States? 

A. 

3. Q. What do you like about watching TV? ~ ^ 

A. 

4. Q. Who is your favorite character in a comic book and why? 
A. 



5. Q. What sport do you like best?^^/^ 
A. 



6. Q. Why would a dog inake the best pet? 
.A. » . 



7. Q. Which subjects do you like the most in school? 
A. ^ - ^ 



C. Q. What would you-llke to do during the suinr^r? 
A. 



9. Q. Where would you like to go for a field trffj^ 



5^ 



A 
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*io. 


Q, 


Whdt would VOU 6XQ^ft to ^pa in A miicpiini'!^ 

rwww I jyjy* ^^yr^\m\t III Q MtUdC Willi 


"Aril. 


q. 

A. 


How do you celebrate your birthday? 




Q. 
A. 


If you had a lot of money, what would you do with It? ^ 


*13. 


Q. 
A, 


Jnicb occupation ^o you like the most? 


14, 


Q: 
A. 


How would you like to utilize your free time? ^ 


15. 


Q. 
A, 


What is a bird of prey? * ' 


16. 


Q. 
A. 


What ftorm of transportation do you use to come to school every day? 


17. 


Q'. 
A, 


What are the advantages of living in a big city instead of^a^^^lJ. town? 

> 


18. 




How would you like to spend your time, if you didn't have to go to % 



19, 



school every day? 



A, 

A. 
Q. 



If you could change 
and why? 





into an aiilmal, which one 



would you Ijke to be 



If you could live in another country, which one would yo« choose anjj 
why? . " . ' 



oose and^ 
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